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Lecture 12. Tuesay, Mar 17: Compactness and weak convergence 

A subset in a general metric space is one with the property that any sequence 
in it has a convergent subsequence, with its hmit in the set. You will recall with 
pleasure no doubt the equivalence of this condition to the (more general since it 
makes good sense in an arbitrary topological space) equivalence of this with the 
covering condition, that any open cover of the set has a finite subcover. So, in 
a separable Hilbert space the notion of a compact set is already fixed. We want 
to characterize it - in the problems this week you will be asked to prove several 
characterizations. 

A general result in a metric space is that any compact set is both closed and 
bounded, so this must be true in a Hilbert space. The Heine-Borel theorem gives a 
converse to this, M" or C" (and hence in any finite dimensional normed space) any 
closed and bounded set is compact. Also recall that the convergence of a sequence 
in C" is equivalent to the convergence of the n sequences given by its components 
and this is what is used to pass first from K to C and then to C". All of this fails in 
infinite dimensions and we need some condition in addition to being bounded and 
closed for a set to be compact. 

To see where this might come from, observe that a set, S, consisting of the points 
of a convergent sequence, s : N — > M, together with its limit, s, in any metric 
space is always compact. The set here is the image of the sequence, thought of 
as a map from the integers into the metric space, together with the limit (which 
might of course already be in the image). Certainly this set is bounded, since the 
distance from the intial point is certainly bounded. Moreover it is closed, although 
you might need to think about this for a minute. A sequence in the set which is the 
image of another sequence consists of elements of the original sequence in any order 
and maybe repeated at will. Since the original sequence may itself have reapeated 
points, the labelling of points is by no means unique. However S is closed since 
M \ S is open - a point in p € M \ 5 is at a finite no- zero distance, d{p, s) from 
the limit so B{p,d{p,s)/2) can contain only finitely many elements of S hence a 
smaller open ball does not meet it. 

Lemma 6. The image of a convergent sequence in a Hilbert space is a set with 

equi-small tails with respect to any orthonormal sequence, i.e. if Ck is an othonormal 
sequence and Un ^ u is a convergent sequence then given e > there exists N such 
that 

(12.1) 5] |(^.„,efe)|2<e2 Vn. 

fe>JV 

Proof. Bessel's inequality shows that for any u gH, 

(12.2) 5]|(«,e,)p<|hf. 

k 

The convergence of this series means that (12.1) can be arranged for any single 
element u,„ or the limit u by choosing N large enough, thus given e > we can 
choose N' so that 



(12.3) 



^ \{u,ek)f<e'/2. 

k>N' 
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In fact, for any orthonormal sequence such as - whether complete or not, 

(12.4) — > Pu = J2{u,ek)ek en 

k 

is continuous and in fact has norm at most one. Indeed from Bessel's inequality, 
||Pm|P < Now, applying this to 

(12.5) Pnu= {u,ek)ek 

k>N 

the convergence Un ^ u implies the convergence in norm ||PArw„|| — > ||PArw|| and 
so 

(12.6) IKefe)r<e2. 

fe>Af' 

So, we have arranged (12.1) for n > n' with N = N'. Of course, this estimate 

remains valid if is increased, and wc may arrange it for n < n' by c;hossing N 
large enough. Thus indeed (12.1) holds for all n if TV is chosen large enough. □ 

This suggest one useful characterization of compact sets in a separable Hilbert 
space. 

Proposition 19. A set K C H in a separabel Hilbert space is compact if and only 
if it is bounded, closed and has equi-small tails with respect to any one orthonormal 

basis. 

Proof. We already know that a compact set is closed and bounded. Suppose the 
equi-smallness of tails condition fails with respect to some orthonormal basis Cfc. 
This means that for some e > and all A'' there is an element G K such that 

(12.7) J2\{uN,ek)f>e\ 

k>N 

Then the sequence {un} can have no convergent subsequence, since this would 
contradict the Lemma we have just proved, hence K is not compact in this case. 

Thus wc have proved the cqui-smallncss of tails condition to be necessary for the 
compactness of a closed, bounded set. So, it remains to show that it is sufhcient. 
So, suppose K is closed, bounded and satisfies the equi-small tails condition with 
respect to an orthonormal basis and {m„} is a sequence in K. We only need show 
that {un} has a Cauchy subsequence, since this will converge {Ti being complete) 
and the limit will be in K (since it is closed). Now, consider each of the sequences 
of coefficients (u„, e^) in C. Here k is fixed. This sequence is bounded: 

(12.8) \iUr^,ek)\<\\Un\\<C 

by the boundedness of K. So, by the Heine-Borel theorem, there is a subsequence 
of Un, such that {un,,ek) converges as I oo. 

We can apply this argument for each fc = 1, 2, First extracting a subsequence 

of {un} SO that the sequence (?i„.ei) converges 'along this subsequence'. Then 
extract a subsequence of this subsequence so that (tin, 62) also converges along 
this sparser subsequence, and continue inductively. Then pass to the 'diagonal' 
subsequence of which has fcth entry the fcth term in the A;th subsequence. It 
is 'eventually' a subsequence of each of the subsequences previously constructed 
- meaning it coincides with a subsequence for some point onward (namely the 
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kth term onward for the feth subsquence). Thus, for this subsequence each of the 
{Uni,ek) converges. 

Now, let's relabel this subsequence Vn for simplicity of notation and consider 
Bessel's identity (the orthonormal set is complete by assumption) for the differ- 
ence 

ll^^n - ■f^n+Hlw = X] \i'"n-Vn+l,ek)\'^ + ^ \{Vn - Vn+l, ek)\'^ 

(12.9) '^"^ 

fe<JV k>N k>N 

where the parallelogram law on C has been used. To make this sum less than 
we may choose N so large that the last two terms axe less than e^/2 and this may 
be done for all n and I by the equi-smallness of the tails. Now, choose n so large 
that each of the terms in the first sum is less than e'^/2N, for alH > using the 
Cauchy condition on each of finite number of sequence {Vn,ek)- Thus, {f„} is a 
Cauchy subsequence of {u„} and hence as already noted convergent in K. Thus K 
is indeed compact. □ 

It is convenient to formalize the idea that each of the {Un,ek), the sequence of 
coefficients of the Fourier-Bessel series, should converge. 

Definition 6. A sequence, {un}, in a Hilbert space, H, is said to converge weakly 
to an element m e W if it is bounded in norm and {uj,v) {u,v) converges in C 
for each v gH. This relationship is written 

(12.10) Un u. 

In fact as we shall see next time, the assumption that ||Mri|| is bounded and that 
u exists are both unnecessary. That is, a sequence converges weakly if and only if 
(Un,v) converges in C for each v G H. Conversely, there is no harm in assuming 
it is bounded and that the 'weak limit' u G H exists. Note that the weak limit is 
unique since if u and u' both have this property then {u — u',v) = lim„^oo (m„, v) — 
lim„^(x)(^in, v) = for all u e W and setting v = u — u' it follows that u = u' . 

Lemma 7. A (strongly) convergent sequence is weakly convergent with the same 
limit. 

Proof. This is the continuity of the inner product. If u„ ^ u then 

(12.11) \{UnM - {u,v)\ < \\un - u\\\\v\\ ^ 

for each v G 7i shows weak convergence. □ 

Now, there is a couple of things I will prove here and leave some more to you for 
the homework. 

Lemma 8. For a bounded sequence in a separable Hilbert space, weak convergence 

is equivalent to component convergence with respect to an orthonormal basis. 

Proof. Let be an orthonormal basis. Then if u„ is weakly convergent it follows 
immediately that (M„,e/j) — > (m, e^) converges for each k. Conversely, suppose this 

is true for a bounded sequence, just that {un.Ck) — > Cfc in C for each k. The norm 
boundedness and Bessel's inequality show that 

(12.12) Eiffel' = li"^ y,\iun,ek)\'<C^sup\\unf 
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for all p. Thus in fact {cfe} G f' and hence 

(12.13) u^Y^Wkek^n 

k 

by the completeness of W. Clearly (un,ek) {u,ek) for each k. It remains to 
show thta {u„,v) {u,v) for all v Gli.. This is certainly true for any finite linear 
combination of the and for a general v we can write 

(12.14) {Un, V) - {U, V) = {Un, Vp) - {u, Vp) + (u„, V - Vp) - {u, V - Vp) => 

\{Un,v) - {U,V)\ = \{Un,Vp) - {u,Vp)\ + 2C\\v - Vp\\ 

where Vp = ^ (w, efe)efe is a finite part of the Fourier-Bessel series for v and C is a 

k<~p 

bound for Now the convergence Vp ^ v implies that the last term in (12.14) 

can be made small by choosing p large, independent of n. Then the second last 
term can be made small by choosing n large since Vp is a finite linear combination 
of the efc. Thus indeed, (u„, v) — > {u, v) for all w e W an it follows that u„ converges 
weakly to u. □ 

Proposition 20. Any bounded sequence in a separable Hilbert space has a 

weakly convergent subsequence. 

This can be thought of as an analogue in infinite dimensions of the Heine-Borel 
theorem if you say 'a bounded closed subset of a separable Hilbert space is weakly 
compact'. 

Proof. Choose an orthonormal basis Ck and apply the procedure in the proof of 
Proposition 19 to extract a subsequence of the given bounded sequence such that 
(w„p, efe) converges for each k. Now apply the preceeding Lemma to conclude that 
this subsequence converges weakly. □ 

Lemma 9. For a weakly convergent sequence Un ^ u 

(12.15) < liminf ||u„||. 
Proof. Choose an orthonormal basis Ck and observe that 

(12.16) y2\\u,ekf= lim ||w„,efcf. 

Now the sequence on the right is bounded by ||wn|P independently of p so 

(12.17) V \\%ekf < liminf 

k<p 

by the definition of liminf . Now, take p ^ oo to conclude that 

(12.18) llwf < liminf 

n 

from which (12.15) follows. □ 
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Problems 6: Due 11 AM Tuesday, 31 Mar 

Hint: Don't pay too much attention to my hints, sometimes they are a Uttle off- 
thc-cufF and may not be very helpfult. An example being the old hint for Problem 
6.2! 

Problem 6.1 Let H he & separable Hilbert space. Show that K c H is compact 
if and only if it is closed, bounded and has the property that any sequence in K 
which is weakly convergent sequence in H is (strongly) convergent. 

Hint:- In one direction use the result from class that any bounded sequence has 
a weakly convergent subsequence. 

Problem 6.2 Show that, in a separable Hilbert space, a weakly convergent se- 
quence {vn}, is (strongly) convergent if and only if the weak limit, v satisfies 

(12.19) \\v\\h = lim \\vn\\H. 

n—^oo 

Hint:- To show that this condition is sufficient, expand 

(12.20) {vn -v,Vn-v) = \\vnf - 2Re(u„, v) + \\vf. 

Problem 6.3 Show that a subset of a separable Hilbert space is compact if and 

only if it is closed and bounded and has the property of 'finite dimensional approxi- 
mation' meaning that for any e > there exists a linear subspace Djv C H oi finite 
dimension such that 

(12.21) d{K,DN) = sup M {d{u,v)}<e. 

Hint:- To prove necessity of this condition use the 'equi-small tails' property of 

compact sets with respect to an orthonormal basis. To use the finite dimensional 
approximation condition to show that any weakly convergent sequence in K is 
strongly convergent, use the convexity result from class to define the sequence {t;^} 
in Djv where w'^ is the closest point in D^r to u„. Show that v'^ is weakly, hence 
strongly, convergent and hence deduce that {vn} is Cauchy. 

Problem 6.4 Suppose that A : H — > i? is a bounded linear operator with the 
property that A{H) C H is finite dimensional. Show that if Vn is weakly convergent 
in H then Avn is strongly convergent in H. 

Problem 6.5 Suppose that Hi and H2 are two different Hilbert spaces and A : 
Hi — > H2 is a bounded linear operator. Show that there is a unique bounded 
linear operator (the adjoint) A* : H2 — > Hi with the property 

(12.22) {Aui,U2)h2 = {ui,A*U2)h, V Ui G Hi, U2 G H2. 
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Solutions to Problem set 5 

You should be thinking about using Lebesgue's dominated convergence at several 
points below. 
Problem 5.1 

Let / : M — > C be an element of £^1^)- Define 



(12.23) /i(x) = 



\f{x) a;e[-L,L] 
otherwise. 



Show that /i e C^{M) and that / - /| ^ as L ^ oo. 

Solution. If XL is the characteristic function of [—N^N] then = fxL- If 
/„ is an absolutely summable series of step functions converging a.e. to / then 
fnXL is absolutely summable, since / I/hXlI < J\fn\ and converges a.e. to /l, so 
/l / £"'^(]R). Certainly \fL{x) — /(a;)| for each x as i ^ oo and \fL{x) — /(x)| < 
|/;(a;)| + \f{x)\ < 2\f{x)\ so by Lebesgue's dominated convergence, J \f — /l| 0. 

Problem 5.2 Consider a real- valued function / : R — > K which is locally inte- 
grable in the sense that 



(12.24) 5i(x) 



.f{x) x&[-L,L] 
a; e M \ [-L, L] 

is Lebesgue integrable of each L G N. 

(1) Show that for each fixed L the function 

{gL{x) iigL{x)&[-N,N] 

(12.25) gf\x)^\N \{gL{x)>N 

{-N i{gL{x)<-N 

is Lcbcsguc integrable. 

(2) Show that / |sf^^^ - 5l| ^ as A/' ^ oo. 

(3) Show that there is a sequence, /i„, of step functions such that 

(12.26) K{x) fix) a.e. in R. 

(4) Defining 

'0 x^[-L,L] 

K{x) if hn{x) e [-iV, N], x& [-L, L] 

N if K{x) > N, x£ [-L,L] 
^-N if /i„(x) < -N, X G [-L,L] 

Show that / \hl^l — fif^^^l ^ as n — > oo. 
Solution: 

(1) By definition g^j^^ = max(— A^xj;,, min(A''xL, ^z,)) where Xl is the charac- 
teristic funciton of -~[L, L], thus it is in £-'^(R). 

(2) Clearly g'"j^\x) gL^x) for every x and |(?^^''(a:)| < so by Dom- 
inated Convergence, (/^^' gL in L^, i.e. / \g^j^^ — ^ as iV ^ oo 
since the sequence converges to pointwise and is bounded by 2|5(a;)|. 

(3) Let Sl.u be a sequence of step functions converging a.e. to g^ for ex- 
ample the sequence of partial sums of an absolutely summable series of 
step functions converging to g^ which exists by the assumed integrability. 



(12.27) = { 
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Then replacing SL,n by SL,nXL we can assume that the elements all van- 
ish outside [—N,N] but still have convergence a.e. to g^. Now take the 
sequence 



(12.28) hnix) 




on [k, -k] \ [{k - l),-{k - 1)], 1 < fc < n, 
on ]R \ [— n, n]. 

This is certainly a sequence of step functions - since it is a finite sum of 
step functions for each n - and on [— L, L] \ [— (L — 1), (L — 1)] for large 
integral L is just SL,n-L Sl- Thus /i„(x) f{x) outside a countable 
union of sets of measure zero, so also almost everywhere. 
(4) This is repetition of the first problem, hl^l (x) g'f^^ almost everywhere 

and 1/^21 1 < NXL so 5f ^ e £i(K) and / j/z^ _ )| ^ o as n ^ oo. 

Problem 5.3 Show that £^(M) is a Hilbert space - since it is rather central to 

the course I wanted you to go through the details carefully! 

First working with real functions, define (M) as the set of functions / : M — > M 
which are locally integrable and such that |/p is integrable. 

(1) For such / choose /i„ and define ql, g^j^^ and by (12.24), (12.25) and 
(12.27). 

(2) Show using the sequence h^^l for fixed N and L that y^^-* and (fl'jf^'')^ are 
in C\R) and that / \{hl^lf - {gi^^)^\ ^ as n ^ oo. 

(3) Show that (5^)2 e C^{m.) and that / \{gi^^)^ - {gL)^\ as TV ^ 00. 

(4) Show that / |(.9l)^ - .P\ ^ as L ^ 00. 

(5) Show that f,g€ C^iR) then fg e C^{R) and that 

(12.29) \j f3\<j \f9\ < ll/IUHl5lU=, ll/lli. = / I/I'- 

(6) Use these constructions to show that £^(R) is a linear space. 

(7) Conclude that the quotient space L^(IR) = £^(]R)/A/', where M is the space 
of null functions, is a real Hilbert space. 

(8) Extend the arguments to the case of complex-valued functions. 

Solution: 

(1) Done. I think it should have been /i|f2. 

(2) We already checked that g^^' e £^(M) and the same argument applies to 
(si^^)' namely (hl^l)^ g^^^ almost everywhere and both are bounded 
by N'^Xl so by dominated convergence 

Kl? - gf^f < N\, a.e. ^ gf ^f G C\R) and 

(12.30) |/.i^i)^-<7r)^|-0a.e. , 
Kl?-9rf\<^N\,=^ j lO^-.fVl-O. 

(3) Now, as TV ^ 00, (fff ))2 ^ {g^f a.e. and {g^^^f ^ {gL? < f so by 
dominated convergence, (gL^ e and / {(gf^)^ - (,9l)^| ^ as TV ^ 00. 

(4) The same argument of dominated convergence shows now that —> 
and f\gl-f\^0 using the bound by f e C^{M.). 



1,2 
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(5) What this is all for is to show that fg G £\R) if /, F = 5 e £^{R) (for 
easier notation). Approximate each of them by sequences of step functions 
as above, h^^l for / and -ff^^^ for g. Then the product sequence is in £^ - 
being a sequence of step functions and 

(12.31) C2(-)<.^(-) - 

almost everywhere and with absolute value bounded by N'^xl- Thus by 
dominated convergence g'^j^^G^j^^ € £^(M). Now, let iV ^ 00; this sequence 
converges almost everywhere to gL{x)GL{x) and we have the bound 

(12.32) )(:r)Gf )(.x)| < \f{x)F{x)\\{f + F^) 

so as always by dominated convergence, the limit ghGL G -C^. Finally, 
letting L — > 00 the same argument shows that fF e £^(]R). Moreover, 
eC^{M) and 

(12.33) l/-^^!-/ I/^I^II/II^^II^II 

where the last inequality follows from Cauchy's inequahty - if you wish, 
first for the approximating sequences and then taking limits. 

(6) So if /, g S £^(M) are real- value, / + g is certainly locally integrable and 

(12.34) (/ + g)2 = /2 ^ 2/g + g^ e C\R) 

by the discussion above. For constants / e £^(M) implies cf € £^(R) is 
directly true. 

(7) The argument is the same as for versus . Namely J = implies 
that P = almost everywhere which is equivalent to / = a@e. Then the 
norm is the same for all f + h where ft is a null function since fh and 
axe null so (/ + /i)^ = + + . The same is true for the inner product 
so it follows that the quotient by null functions 

(12.35) L'^{R) = C^{m.)/N' 

is a preHilbert space. 

However, it remains to show completeness. Suppose {[/«]} is an ab- 
solutely summable series in Z/^(M) which means that X^H/nlUs < 00. It 

n 

follows that the cut-off series /„Xl is absolutely summable in the sense 
since 

(12.36) I \fnXL\<LHl fji 

n 

by Cauchy's inequality. Thus if we set F„ = ^ fk then Fn{x)xL converges 

fe-i 

almost everywhere for each L so in fact 

(12.37) Fn{x) fix) converges almost everywhere. 

We want to show that / G £^(M) where it follows already that / is locally 
integrable by the completeness of . Now consider the series 

(12.38) ffi = F^, 5„ = F^ -F^_,. 



as n — > oo. 
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The elements are in £^(M) and by Cauchy's inequality for n > 1, 

(12.39) 

/ \9n\ = j Wl- F^_^\'' <\\F^- F^_4i^4F^ + F^_4l. <\\f^\\L.2Y,\\fk\\L- 

k 

where the triangle inequality has been used. Thus in fact the series (/„ is 
absolutely summable in £^ 

(12.40) I l5n|<2(^||/„|U.)^. 

n ^ n 

So indeed the sequence of partial sums, the F^ converge to p G £^(M). 
Thus f € (M) and moroever 

(12.41) I (F„ - /)2 = y F2 + y /2 - 2 1 F„/ ^ 

Indeed the first term converges to / and, by Cauchys inequality, the 
scries of prochicts /„/ is absulutcly suinmablc in with limit so the 
third term converges to —2 J p. Thus in fact [F„] [/] in L^(M) and we 
have proved completeness. 
(8) For the complex case wc need to check linearity, assuming / is locally 
integrable and |/p G £^(]R). The real part of / is locally integrable and the 
approximation F^j^^ discussed above is square integrable with {pf^^Y ^ 
l/P so by dominated convergence, letting first TV oo and then L ^ oo 
the real part is in £^(M). Now linearity and completeness follow from the 
real case. 

Problem 5.4 

Consider the sequence space 

(12.42) /i^.i = |c : N 9 j I — > cj G C;^(l + /)|cjf < oo 

(1) Show that 

(12.43) /i^'^ X /i^'i 9 (c, d) I — > (c, d) = ^(1 + f)cjdj 

j 

is an Hermitian inner form which turns h"^'^ into a Hilbert space. 

(2) Denoting the norm on this space by || • ||2,i and the norm on P by || • ||2, 
show that 

(12.44) h^'^cf, ||c||2< ||c||2,i Vce/i^'^ 
Solution: 

(1) The inner product is well defined since the series defining it converges ab- 
solutely by Cauchy's inequality: 



{c,d) = J2i-^ + f)hj{l + f)hdj, 

(12.45) f 

^|(l+j2)ic,(l+j2)id,|<(^(l+j2)|e,|2)l(^(l+j-2)|rf.|2)i. 
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It is sesquilinear and positive definite since 

(12.46) \\ch,i = {Y.{l+f)\cA^)'^ 

j 

only vanishes if all cj vanish. Completeness follows as for P - if c^"^ is a 
Cauchy sequence then each component c^"-* converges, since (1 + j)^c^j^^ 
is Cauchy The limits Cj define an element of h^'^ since the sequence is 
bounded and 

N N 

(12.47) ^(l+/)i|c,f = hni ^(1+/)|4")|2<A 

n— >(x> ■' 
j=l j=l 

where ^ is a bound on the norms. Then from the Cauchy condition c^"' — > c 
in h"^'^ by passing to the limit as to ^ oo in lie*-""-* — c*''"-'||2,i < e. 
(2) Clearly /i^'^ C P since for any finite N 

(12.48) Elc^f Bl+jflc^f <||c||i,i 

i=i i=i 

and we may pass to the limit as iV ^ oo to see that 

(12.49) \\c\\p < ||c||2,i. 

Problem 5. 5 In the separable case, prove Riesz Representation Theorem directly. 

Choose an orthonormal basis {e,;} of the separable Hilbert space H. Suppose 
T : H — > C is a bounded linear functional. Define a sequence 



(12.50) w, = T(e,), i e N. 

(1) Now, recall that \Tu\ < C\\u\\h for some constant C. Show that for every 
finite A'', 

N 

(12.51) 1]KP<C2. 

(2) Conclude that {wi} G P and that 

(12.52) w = ^WieiGH. 

i 

(3) Show that 

(12.53) T{u) = {u,w}h y uG H and \\T\\ = \\w\\h. 
Solution: 

N 

(1) The finite sum wn = X] WjCj is an element of the Hilbert space with norm 

N 

= X] l^iP by Bessel's identity. Expanding out 

i=l 

N n N 



(12.54) T{wn) = T{J2 ^'he^ = J2 "''^(e») = Yl 



i=l 



and from the continuity of T, 
(12.55) \T{wn)\ < C\\wn\\h =^ \\wn\\1 < C\\wn\\h =^ lkjv||' < 
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which is the desired inequaUty. 

(2) Letting A'' — > oo it follows that the infinite sum converges and 

(12.56) ^\wif <C^ ^w = ^WieieH 

i i 

since ||m;jv — w|| < Yl, l^iP tends to zero with N. 

j>N 
N 

(3) For any u G H un = Yl by the completness of the {ej} so from the 

i=l 

continuity of T 



N 

(12.57) T{u)= lim T(wjv) = Hm {u,ei)T{ei) 



i=l 

N 



= lim y {u,Wiei) = lim {u,wn) = {u,w) 

=1 



where the contimiity of the inner product has been used. From this and 
Cauchy's inequality it follows that ||T|| = sup||„||^^i |T(u) | < \\w\\. The 
converse follows from the fact that T{w) = WwWj^. 



